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DIGITAL IMAGING 

Background of the Invention 

The present invention relates to drbltal 
particularly to contrast and edge enljancement 
imaging. 



Digital imaging offers a great many 
techniques, supporting services such 
applications. Accordingly, digital i 
research. 



advantages over traditional analogue 
as video telephony and multi-media 
imagirjg is currently the subject of extensive 



re sear 



inage 



poor 



devel apment 
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One particular area of digital imaging 
In digital imaging, there is need for i 
typically suffer from various types of 
noise, compression artefacts, and 
Imaging products presently under 
degradations due to the low performance 
and the narrow data transmission bar 
communications networks, which requires 
In digital camera products, poor Image 
fundamental sensor properties. The lack 
sensor Itself, while the lack of sharpness 
and low sensor resolution. Low resolution 
imaging systems of forthcoming first 
terminals with Image presentation and 
is a need for methods to enhance 
current digital image enhancement 
concealing artefacts and reconstructing 



image 



: techniq 
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imaging technology, and more 
in still and moving digital 



rch is that of image enhancement, 
enhancement because images 
degradation, such as lack of sharpness, 
contrast and brightness. Mobile 
are especially prone to such 
of current digital camera devices 
dwidth typically available in mobile 
the use of high compression ratios, 
quality arises from shortcomings in 
of contrast typically arises from the 
is the result of both low quality optics 
sensors are likely to be used in the 
generation mobile telecommunication 
manipulation functionality. Thus, there 
contrast and sharpness, and in 
ues this is commonly carried out by 
degraded parts of an image. 
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accentuation of image features such 



Image enhancement principally concerns 
as edges, boundaries, or contrast. This makes image details more visible and 
makes images look subjectively sharDer or crisper without appearing 
unnatural, therefore making a graphic cfsplay more useful for display and 
analysis. Whilst the enhancement proc ess does not Increase the inherent 
Information content In the data, it does increase the dynamic range of chosen 
features so that they can be more easily cetected. 



Image enhancement techniques can be d 
comprising point, spatial, and transform 



operations. 



Point operations are performed on in|divid 
independent of surrounding pixel values 
example of point operations. Pixel 
a new value with a function, for example 

where 

^ j = pixel's coordinates 
y = output pixel 
X = input pixel 

and f is a function relating x and y. 



ual pixels and as such are 
Pixel mapping operations are one 
mappirfg involves mapping a pixel value to 



Spatial operations are performed on 
smoothing and filtering functions are 
pixel's value may be modified by takinc 
values. 



Transform operations convert image data 
for example spatial frequency components, 
and wavelet transforms are examples of transform 
in image processing applications. 



vided roughly into three sub-classes 



groups of pixels. Certain image 
spat |ai operations where, for example, a 
an average of surrounding pixel 



rom pixel values into another form, 
Discrete cosine transforms (DCT) 
operations commonly used 



P. 008 



20-DEC. ■ OO(WED) 12:55 



FAX:01252865080 



P. 009 



m 



10 



15 



20 



25 



0 



Examples of enhancement techniques 
include techniques such as grey levcJ 
reduction, edge crispening and shajpening 
magnification, and pseudo-colouring. 



in the sub-classes outlined above 
and contrast manipulation, noise 
filtering, interpolation and 



Referring first to contrast enhancement, 
contrast is histogram-based pixel mappirjg 
function is formed utilising a histogram o 
The histogram contains the number of piiel 
input signal range. The mapping function 
histogram so that it has high slope co 
histogram. The cumulative histogram is 
having the form: 



where 

C, = bin i of cumulative histogram 
= bin k of histogram 



In practice, images taken by a digital canr era normally suffer from smoothness 
problems Irrespective of the pixel resoluton. This means that there is always 
likely to be a need for image sharpening techniques. Image sharpening can 
be performed by applying various fornis c»f contrast enhancement (stretching / 
shrinking) and edge enhancement techniques. Contrast enhancement is a 
point operation that can be used to enhance images taken in poor or non- 
uniform lighting conditions, or acquired wth an imaging sensor having a small 
dynamic range. Contrast manipulation also tends to alter the visibility of 
edges, which changes the perceived sharpness of the image. Edge 
enhancement techniques are typically spatial operations and they enhance 
images that suffer from overall smoothness. A technique known as unsharp 
masking is an example of an edge enhan<:ement technique. 



well known method for enhancing 
In this method a pixel-mapping 
the Image, or a part of an image, 
occurrences at each level of the 
is derived from a cumulative 
responding to high values in the 
typically formed using an equation 
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Note that a bin is a pixel value range, 
more than one pixel value. 



In the basic method the mapping functi|on is: 



that may cover a single pixel value or 



The mapping function or the cumulati 
the mapping covers substantially exac 



ve histogram is typically scaled so that 
Hy the available dynamic range, i.e.; 



where 

L = largest value of the available dynamic tange 
The scaling is achieved, for example, using equation 



fix) = 



The above equations can be found i 
processing textbooks. For example 
nonzero bin is subtracted from the his[togram 
the cumulative histogram. If such a 
pixel value of the image is not mappejd 
also exist. 



1 slightly varying forms in many signal 
in one altemative approach the first 
before or during computation of 
Subtraction is not performed the darkest 
to zero (C(, 5* 0). Other modifications 



The above equations are usable sub<5tantially only if there are as many bins 
as signal levels, for example, 256 bins are required for a signal with 8 
bits/sample. If fewer bins are used, ^ach bin contains pixels belonging to a 
certain signal range. The above equations provide mapping function values 
at the borders of bins. Additional valu ss may be obtained by interpolation. 
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Examples of a histogram , a cumulative 
function are presented in Figure 1 . 



Using histogram-based pixel mappinc 
can be increased by mapping input 
linear function having a slope (i.e 
than one decreases contrast, while a 
in contrast. The mapping function 
slope. In this case contrast aroun(|l 
increased, the contrast In other pixel 
altered at all. An example of a 
Figure 2. 



contrast increases the visibility of varia 



histogram and corresponding mapping 



techniques, the contrast of an image 
values to output pixel values with a 
derivative) greater than one. A slope less 
slope equal to one produces no change 
also be non-linear, having a varying 
some pixel values of the image is 
/alue ranges may be decreased or not 
non-linear mapping function is shown in 



pi<el 



cen 



An acknowledged limitation of histogram-based pixel mapping is that it tends 
to make noise and other artefacts disturbingly visible. Because increasing 



tions in the input signal, if there is noise 



present in the input signal, its visibility is also increased. Because of this, 



histogram-based pixel mapping is ofte 
enhancement of natural images. 



Nevertheless, histogram-based pixel 
number of contrast enhancement a 
a mapping function based on the I 
mitigate the unwanted effects of 
modifications and additions to the 
include, for example, reshaping th 
function, filtering the image, the 
limiting the maximum value of the histogram 



n considered unsatisfactory for contrast 



mapping is the basis for a substantial 
Igojrithms. So, whilst these algorithms form 
injiage histogram, attempts are made to 
the basic mapping procedure using 
^asic algorithm. These modifications 
B histogram, reshaping the mapping 
histogram or the mapping function and 
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Turning now to edge enhancement, specifically in the context of unsharp 
masking, this Is a spatial filtering technique for improving th© visibility of edges 
and thus Improving perceived image quality. Unsharp masking is commonly 



se^cond 



implemented in the form of a highpass 
block, as shown in Figure 3. In the 
filtered and scaled image signal is 
shown in Figure 4a. Thus, the 
emphasising high frequency components 
of the highpass filter represents a 
signal, as represented in Figure 4b. 
added back to the original signal, it 
edges as shown in Figure 4c. The hui[nan 
under and overshoots around sharp 
the Mach band effect. It demonstlrates 
perceives edges in a non-linear manner 
on luminance but also on image structu 
system perceives edges with added 
produced by unsharp masking, as s 



filter in series with an adjustable gain 
illustrated arrangement, a highpass 
added to the original image signal as 
desired improvement is achieved by 
of the image. Specifically, the output 
order derivative of the original 
When the highpass filtered signal is 
l^reates under and overshoots around 
visual system itself creates similar 
edges. This phenomenon is known as 
that the human visual system 
, and that perception depends not only 
re. For this reason, the human visual 
under and over shoot, such as those 
edges. 



harper > 



Unsharp masking also tends to pro duce 
presence of a highpass filter makes 
compression artefacts. Thus, 
perceivable artefacts, which are esp 
image. 



nput 



U!>e 



Accordingly, it has been recognised 
would be appropriate to modify an i 
when there is a noise componen 
modification, known in the art, is to 
mapping function prior to unsharp 
mapping function, it is possible to e 
unwanted noise enhancement. Figure 
that utilises pixel mapping prior to 
arrangement, a pixel mapping functioih 



some undesirable effects. The 
the system sensitive to noise and 
unsharp masking typically produces 
ecially visible in uniform areas of an 



tiat 



in order to improve image quality it 
signal of the highpass filter, especially 
present in an image. One such 
a standard, predefined, or fixed pixel 
mdsking. Using a conventional fixed pixel 
mphasise certain edges, whilst limiting 
5 depicts an unsharp masking scheme 
highpass filtering. In the illustrated 
is applied to the image before unsharp 
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masking in order to limit the unwantod 
that occurs as a result of high-pass f lite ring. 



Figure 6 shows two possible pixel 
prior to unsharp masking. Curve l 
stretches mid-range pixel values, 
low level edges are suppressed and 
2 mid level edges are suppressed 
enhanced. In this way, the effect of 
filtering Is to reduce noise. 



majpping function curves suitable for use 
ses high and low level signals and 
Acco|rdingly, in the highpass filter, high and 
level edges are enhanced. In Curve 
and high and low level edges are 
using pixel mapping prior to highpass 



mid 



applying 
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The effect of a function such as Curve 
Figure 7. This shows the effect of 
function to an image that contains a 
transition from dark to light i.e. from verv 
intensity pixel values. In other words, 
one of low luminance values and one o 
Figure 7a. Figure 7b presents a graph 
across a row of pixels from left to right 
which should be of essentially unlfonn i 
The noise manifests itself as small 
from the 'ripple' in Figure 7b). By 
illustrated in Figure 7c, the noise in the i 
effectively. The result of the fixed 
Figure 7d. The way in which the noise 
examining the pixel mapping function in 
the pixel mapping function describes th 
original image (i.e. that described by 
values in the contrast enhanced (adjuste 
illustrated in Figure 7d. Considering first 
region of the image, the relevant part o 
labelled 'A' in Figure 7c. This part of the 



pixsl 



enhancement of noise components 



1, shown in Figure 6, is illustrated in 
a conventional fixed pixel mapping 
single 'edge*. Here the edge is a 
low intensity pixel values to very high 
the image contains just two regions, 
high luminance values, as shown in 
of pixel values created by scanning 
It is assumed that the two regions, 
intensity, exhibit some degree of noise, 
in pixel value (as can be seen 
the fixed pixel mapping function 
of Figure 7b can be suppressed 
3l mapping function is illustrated In 
suppressed can be understood by 
detail. It should be appreciated that 
e way in which pixel values in the 
igure 7b) are converted into pixel 
image, whose pixel value profile is 
reduction of noise in the low intensity 
the pixel mapping function is that 
pixel mapping function determines 



varieitions 



applying 



image 



c) 
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how low intensity pixel values In the 
intensity pixel values in the contrast 
function has a gradient less than 1 , i 
be reduced (or 'compressed') by 
region 'B' of the pixel mapping function 
detennines the way in which high intens 
are translated into high intensity pixel 
Thus, noise is effectively reduced at both 
how mid-range intensity values are 
this example, the part of the function 
and therefore, the range of pixel value 
enhanced (expanded or stretched), 
between low and high Intensity values 
considered as a true sharpening of the 
unsharp masking. Contrast expansion 
difference between nearly identical mic 
enhances the effect of noise in the pixel 



values 



conve rted 



original image are translated into low 
I image. Here the pixel mapping 
indldating that variations in pixel value will 
applyir g the function. The same is tnje in 
of Figure 7c. This part of the curve 
ity pixel values in the original image 
in the contrast-enhanced image, 
extremes of the range. Referring to 
by the pixel mapping function in 
iabelHed C has a gradient greater than 1 
variation in this region is actually 
changing the profile of the transition 
However, this effect cannot be 
ransition, such as that provided by 
has the effect of enhancing the 
-range pixel values and inevitably 
vklue range around the transition. 



The use of conventional fixed pixel mapping functions in order to condition an 
image prior to unsharp masking has certain limitations. These will be 
described with reference to Figure 8, whi:h illustrates the effect of using the 
same pixel mapping function, introduced above, to enhance the contrast of a 
second example Image, As in the first example, the image considered in 
Figure 8 is a very simple one. comprising two substantially unifonn regions, 
one darker than the other (Figure 8a). The difference in intensity values 
between the two regions is less than in tne previous example, although the 
same kind of noise is present (Figure fib). The effect of the fixed pixel 
mapping function Is illustrated in Figure 8(J. While noise in the darker region 
is suppressed, noise In the lighter region is actually enhanced. This effect 
occurs because the pixel values of the ligh er region correspond to a region of 
the pixel mapping function that has a gracient greater than one. Thus, small 
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differences in pixel value are enhancejj 
increase in noise. 
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It is common tliat images are processec using both (fixed or histogram-based) 
pixel mapping contrast algorithms and unsharp masking edge enhancement 
algorithms. Referring to Figure 9. the c ombinatPon of histogram -based pixel 
mapping and unsharp masking can be implemented by placing the histogram- 
based pixel mapping in the original im age signal branch before (Option A). 



after (Option C). or in parallel (Option 



rather than suppressed, causing an 



B) with an edge enhancement unit. 



Commonly, image processing applicalions, such as certain commercially 
available software packages, implement options A or C, giving rise to a 
cascaded structure. However, it has been found that the best results are 
achieved by option B. in which a histogram-based pixel mapping unit is placed 
Inside the unsharp masking unit, that Is in the original image signal branch, in 
parallel with the highpass filter and not i i 
C- In option B, any unwanted noise 
contrast enhancement, is not hlghpas 

emphasised. Jn both options A and C tf,e second operation in the'cascaded 
structure further emphasises noise artefacts introduced by the first operation. 
Here, the second operation refers to the 
second operation is unsharp masking, anc 
histogram-based pixel mapping. Thus. 



disadvantage that noise is 'doubly' enharced. This can create very annoying 



noise structures, especially if a JPEG or 

used to compress the original source image. For example, assuming option^A 
is used, initial contrast enhancement causes a certain increase in pixel value 
noise. This is further exaggerated by the 
using e.g. unsha^. masking. In the casi of option C. because the unship' 
masking emphasises edges it also heightens noise around edges. The 
amplitude of this noise is then further 
contrast enhancement. Also, other artefak caused b^ the'uns'harp^maskrn7 
for example ringing effects may becotfie more visible. The approach 



cascade with it as in options A and 
component that is emphasised by 
iss filtered and thus not further 



latter operation, i.e. in option A, the 
d in option C the second operation is 
the cascaded approach has the 



DCT based hybrid codec has been 



!0-DEC. ■ OO(WED) 12:58 



FAX:01252865080 



P. 016 



10 



15 



20 



25 



1(* 



illustrated by option B» on the other hard, avoids double noise enhancement. 
Here, contrast and edge enhancement are performed in parallel and the high 
pass filtered image is added to the conljrast enhanced image (as indicated by 
the addition symbol in Figure 9). 



Nevertheless, the combined image enlfiancement 
from the problems associated with contrlast 
described above. 



aspect 



Summary of the Invention 

Against this background, and in one 
method for image enhancement of a dijgital 
pixels, the method comprising applying 
function to the image pixels. 



The inverse histogram-based pixel 
in connection with any of options A 
particulariy preferred embodiment, inve 
applied in connection with option B 



maplping function can be applied alone, or 
B and C described above. In a 
rse histogram-based pixel mapping is 



-basod 



Alternatively, an inverse histogram 
connection with any image processi^ig 
histogram-based pixel mapping function 
image processing function that tend 
preferably, the inverse histogram-based 
pre-processing step prior to an 
enhance noise visibility. 



imaqe 



options of Figure 9 suffer 
and edge enhancement previously 



, the present invention resides in a 
mage comprising a set of image 
an inverse histogram-based mapping 



pixel mapping function is applied in 
function. Preferably, the inverse 
is applied in connection with an 
5 to enhance noise visibility- Most 
pixel mapping function is applied as a 
processing function that tends to 
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In a preferred form of this aspect of the invention, an inverse histogram-based 
pixel mapping step is combined with an edge enhancement step, such as 
unsharp masking. In such an arrangement the inverse histogram-based pixel 
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mapping step improves the performance 
has an advantageous effect on 
unsharp masking techniques. 



of the unsharp masking step, it also 
combihations of contrast enhancement and 



5 As explained earlier, unsharp masking techniques augment the subjective 
sharpness of an image by adding overshoot and undershoot components to 
edges within an image. The effect of ir verse histogram-based pixel mapping 
is to change the pixel values according to their frequency of occurrence. In 
embodiments in which the inverse histogram-based pixel mapping step is 
1 0 combined with an edge enhancement step, such as unsharp masking, the role 
of the inverse histogram based pixel ms pping is to act as a pre-processor for 
the highpass filter unit inside the edgci enhancement unit, that alters pixel 
values in such a way that noise enhancement introduced by subsequent edge 
enhancement is reduced. 



This arrangement serves to minimise the amplificaton of noise components, 
while desired signal components are enhanced. More specifically, inverse 
histogram-based pixel mapping producss a reduction in contrast at signal 
ranges containing a large number of pixels and an increase in contrast 
elsewhere. Thus, noise Is suppressed in e.g. uniform areas, where it is 
subjectively most visible. It has been found that the effect is substantially the 
same when inverse histogram-based pixel mapping is applied to: a) a large 
uniform area, and b) an area containing a large number of pixels having a 
small number of different values (e.g. a s Deckled region). 



Hon, there is also provided a device, 



According to the first aspect of the invent 
such as a portable radio communicalion device, comprising means for 
performing said image enhancement met nod. 



According to the first aspect of the 
software program, comprising machine 
processor unit to perform said image enlfiancement 



in\|'ention, there is further provided a 
readable instructions for causing a 
method. The first aspect 
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of the invention also extends to a 
medium and configured to perform said 



scjftware program product stored on a 
image enhancement method. 



According to a second aspect of the i 
image enhancement of a digital image 
method comprising applying, in a brancl|i 
parallel to an original image branch 
function to said set of image pixels 
branch. 



invention, there Is provided a method for 
comprising a set of image pixels, the 
of an edge enhancement unit that is 
a histogram-based pixel mapping 
pric^r to applying a highpass filter in said 



such 



As described earlier, use of a fixed pixe 
unsharp masking prior to high-pass fllte 
5. This has the disadvantage that 
enhance contrast in certain pixel valu^ 
noise components in the image varies 
as evidenced by the description of Flgur4s 
have noted that because the function 
artificially it cannot be altered to adapt 
optimal for all images. 



mapping function in connection with 
ring is known, as illustrated in Figure 
a function can only be chosen to 
ranges. Furthermore, its effect on 
Recording to the nature of the image. 
7 and 8. Accordingly, the inventors 
lustrated in Figure 6 is constructed 
Image content and is therefore not 



in contrast, the inventors have recognised that because a histogram-based 



pixel mapping function is constructed wi 
adaptive to image content and hence so 
enhancement can be reduced. 



:h reference to the image itself, it is 
me of the problems relating to noise 



Used in conjunction with edge enhancerhent 
such that once a histogram of pixel 
determined, the profile of the histogram 
nature of the pixel mapping function creat 



the histogram can be adapted 
/alues within an image has been 
be altered in order to change the 
3d from it. 



20-DEC. ' OO(WED) 12:59 



FAX:01252865080 



P. 019 



Brief Description of the Drawings 

Referring now to the accompanying 
conjunction with an account of the prior 
Figure 1 shows a histogrann and 



(ffrawings, Figures 1 to 9 are used in 
art in which: 
corresf)onding mapping function; 



Figure 2 illustrates a non-linear mapping function; 

Figure 3 shows a block diagram of an uisharp masking scheme; 



1 0 Figure 4 illustrates the effect of an 
image signal; 



unsharp masking scheme on an edge of an 



Figure 5 shows an unsharp masking scheme 
prior to a highpass filter of the unsharp 



na 



15 



Figure 6 illustrates two possible curves cf a pixel mapping function of figure 5; 



Figure 7 shows the fixed pixel mapping 
noisy Image; 



20 



Figure 8 shows a fixed pixel mapping 
noisy image; 



Figure 9 shows possible locations for a contrast enhancement unit. 



25 



The present invention will now be 
reference to the accompanying drawings 

Figure 10 illustrates one embodiment 
30 invention; 



with a fixed pixel-mapping unit 
sking scheme; 



function applied to an edge in a first 



fufiction applied to an edge in a second 



desc ribed 



by way of example only, with 
in which: 

of the first aspect of the present 
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Figure 11 illustrates an inverted his 
embodiment of Figure 10; 



Figures 12, 13 and 14a-e show 
5 the present Invention; and 



alternative arrangements of the first aspect of 



Figure 15 shows an embodiment 
invention. 



acoording to a second aspect of the 



pl>el 



rnaice. 
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Detailed Description of the Invention 

The first aspect of the present invention 
histogram-based pixel mapping techniqu 
well known, a digital image comprises 
monochrome Image, each pixel has a 
- 255), which denotes the pixel's lum 
may be represented in a number of 
representation, referred to as the RGB 
by three values, one corresponding to th 
another corresponding to the value of a G 
corresponding to the value of a Blue 
colour models exist, in which alternativ^ 
such alternative model, known as the 
represented by a luminance componert 
difference components, each of which 
Generally, colour models that employ 
components provide a more efficient 
the RGB model. It Is also known that the 
models generally provides the most 
of an image. Therefore, application of 
according to the colour model used to 
example, in an image represented using 



ogram constructed according to the 



resides in the provision of an inverse 
3 for enhancing a digital image. As is 
an array of pixels. In the case of a 
value within a certain range (e.g. o 
In a colour image, pixel values 
different ways. In a commonly used 
colour model, each pixel is described 
e value of a Red colour component, 
reen colour component and the third 
c|;olour component. Numerous other 
representations are used. In one 
colour model, image pixels are 
and two chrominance or colour 
has an associated pixel value, 
luminance and colour difference 
redresentation of a colour image than 
lijjminance component of such colour 
about the perceived structure 
the present invention may vary 
represent a particular image. For 
e RGB colour model, the method 



YUV 



infomiation 



h£ 
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5 according to the invention can be 



according to the invention may be applied to one, two, or all three colour 
components. On the other hand, if an image Is represented using the YUV 
model, it may be more efficient, for excimple. to apply the method according to 
the invention to just the Y component. However, in general, the method 



applied to all components, or any 



combination (including just one) of t ie components of a particular colour 
model. Thus, it should be appreciated that the choice of colour model is 
essentially insignificant for application of the invention, as the basic principles 
used to construct the inverse histogram-based mapping function can be 



applied to any colour model comprising 



Whilst this invention can be used in 
been found that it provides particularly 
image processing function that tend 
approach of the present invention, as 
a device that includes means for ap 
mapping to a digital image. In a specifi 
telecommunications terminal, such 
conventional radio frequency, hardware 
required of a mobile phone and that 
capability and / or image capturing 
device may simply be a computer 
means implementing the method a 
case, the mobile temninal is able to mak^ 
transmission of a captured image, and / 
display on the mobile tenminal. 



30 



Referring initially to Figure 10. there is 
histogram-based pixel mapping unit that 
for a highpass filter unit inside an 
histogram-based pixel mapping unit is 



any number of components. 



isolation to operate on an image, it has 
beneficial results when used with any 
1 5 to Increase noise visibility. The 
as being a method, resides also in 
3lying inverse histogram-based pixel 
2 context, the device may be a mobile 
s a mobile phone, that has the 
and software means normally 
is equipped with image processing 
display means. Alternatively, the 
with digital image processing 
to the invention. In the former 
use of the present invention prior to 
or for processing received images for 



ard 



equipped 



iccording 



s lown one embodiment of an inverse 
s provided as a pre-conditioning unit 
ur sharp masking unit. The inverse 
cisposed in series with the highpass 
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filter that is inside the edge 
loop that is parallel to the original image 



enhancemlent unit and both are in a branch or 
signal branch. 



tie 



The inverse histogram-based pixel 
example, by inverting an image histogt|am 
histogram from the maximum value of 
illustrated in Figure 11. A standard 
and the maximum value of the histogram 
the histogram is subtracted from this 
histogram is created. Finally, the im 
function is derived from the cumulatiye 
histogram, the mapping function is 
used in the conventional histogram-bas 
appreciated that the inverse histogram- 
inverse function in a strict mathematica 



tie 



Thus, in one way the formation of 
function comprises the steps of: coristructing 
values, optionally processing the histogram 
from the histogram, optionally processing 
cumulative inverse histogram from 
processing the cumulative inverse his 
based pixel mapping function from 
processing the inverse mapping function 
inverse histogram-based pixel mapping i 



The "inversion" can be performec 



mapping function can be formed, for 
and then subtracting the inverted 
original histogram. This method is 
histogram is first obtained from an image 
is determined. Then, every value in 
maximum value. Next, a cumulative 
erse histogram-based pixel mapping 
histogram. After inversion of the 
folrmed in a manner analogous to that 
3d pixel mapping method. It should be 
Dased pixel mapping function is not an 
sense (Le, fi„,ix) ^ f~\x)). 



inverse histogram-based mapping 
a histogram of image pixel 
, making an inverse histogram 
the inverse histogram, making a 
the inverse histogram, optionally 
ogram, making an inverse histogram- 
the inverse histogram, optionally 
, and mapping pixel values using the 
function. 



on the cumulative histogram, or 



alternatively it can be applied to the mapping function. For example. 



formation of an inverse histogram 
comprise the steps of: constructing 



optionally processing the histogran, making a cumulative histogram, 



based pixel mapping function may 
a histogram of image pixel values. 
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optionally processing the cumulative histogram, making a mapping function 
from the cumulative histogram, optionally processing the mapping function, 
making an inverse mapping function, optionally processing the Inverse 
mapping function and, mapping pixel values using the inverse histogram- 
5 based pixel mapping function. 
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In constructing a histogram it is possible that regional histograms could be 



used, i.e. a histogram representing a 
original histogram may be processec 
inverse histogram. Modifications c 



histogram. In addition, it is also possible to make an inverse mapping function 
from a mapping function derived from t le original histogram. It should also be 



noted that the inverse histogram-based 



the pixels within an image or to a set of image pixels, for example pixels 
corresponding to a specific region within an image. 



Because the inverse histogram-based 



localised portion of the image. The 
or modified before constructing an 
n also be applied to the inverted 



mapping function can be applied to all 



pixel mapping function is derived from 



the inverse histogram via an inverse cumulative histogram, and the 
conventional (non-inverted) histogram-based pixel mapping function is derived 
20 from an image histogram via a cumulative histogram, the inverse histogram- 



based pixel mapping function and 



mapping function share a relationship with one another. Therefore, as 
explained above, there are various ways to constmct an inverse histogram- 



based pixel mapping function from 



a conventional histogram-based pixel 



conventional histogram-based pixel 



mapping function or from a cumulaltive histogram. For example, if the 
conventional histogram-based mapping function is differentiated, the 
derivative is inverted (in this context the inversion means subtraction from the 
maximum value) and the result is intec rated, the obtained mapping function is 
the inverse histogram-based pixel mapping function. 

In an alternative approach, the immerse histogram-based pixel mapping 
function is produced by subtracting ^ach value of a cumulative histogram 
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froTi 



£10 



basad 



(formed in a conventional manner) 
histogram value. Furthermore, adding 
limitation of the maximum dynamic 
Other modifications can also be applied 
formation of the inverse histogram 
should be noted is the principal shape 
the original. Peaks in the original histtj^gram 
the inverse histogram and vice versa, 
that regions of high-gradient are trans 
vice versa. 



a value larger than the maximum 
offset to the maximum value allows 
range suppression (no zero slopes), 
to the inverted histogram prior to 
pixel mapping function. What 
3f the inverted histogram compared to 
are transformed into troughs in 
In mapping function terms this means 
ormed to regions of lov\/-gradient and 



Accordingly, the inverse histogram-bas2d pixel mapping function is formed so 
that it has a high slope con-espohding to low values in the image histogram 
(i.a. pixel value ranges with a small number of occurrences) and a low slope 
con^esponding to high values in the image histogram (i.e. pixel value ranges 



with a large number of occurrences). 



to output pixel values using this kind cf function is that contrast is reduced in 
signal ranges containing a large number of pixels and increased elsewhere. 
This kind of contrast manipulation decreases the visibility of small variations 
and noise in the statistically most important signal ranges. For example, pixel 
value ranges that contain large nunrbers of pixels typically correspond to 



areas of an image having a substant 



enhancement unit of an unsharp ma 
of noise ordinarily caused by unsharp 
amplification is particularly disturbinc 
codec has been used to compressj 



he effect of mapping input pixel values 



ally uniform intensity or colour. It is in 



precisely these areas that noise, i.i^. small variations in pixel value are 
subjectively most visible. 

It has been found that by applying a F)ixel mapping function constructed from 
an inverse histogram of the imace to the image prior to the edge 



king block, the problem of amplification 
masking is significantly reduced. Noise 
when a JPEG or DCT based hybrid 
the source image, and the present 
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invention has been found to be 
images. 



particularly usetul when applied to such 



25 



at 



extensive 



irn 



Because inverse histogram-based pixel 
visibility in statistically important signal 
by unsharp masking is also reduced 
advantageous effect, for instance, whe|i 
and smooth area. Such an 
concentration of high values in the 
based pixel mapping has the effect 
subsequent unsharp masking, particularly 
Elsewhere the unsharp masking sh 
while edges are suppressed in one 
values representing a large smooth 
dynamic range. Therefore "real 
without restrictions. 



area 



mapping reduces contrast and noise 
ranges, noise enhancement produced 
these signal ranges. This has an 
the image contains a relatively wide 
smooth area gives rise to a 
age histogram. Inverse histogram- 
reducing noise amplification due to 
in such a large and smooth area- 
edges without restrictions. Thus, 
of the dynamic range e.g. for pixel 
, they are enhanced elsewhere in the 
s" between regions are enhanced 



cf 



arpens 



part 



edge 



As previously explained, image 
unsharp masking and a histogram 
enhancement. In this case, it has 
according to the present invention 
quality. Inverse histogram-based pixel 
the areas of the image that are e 
algorithm. Due to this feature, both a 



based 
betjn 
sigiifi 



30 



Figure 12 shows an example of an 
which inverse histogram-based pixe 
conventional histogram-based pixel 
unsharp masking. A conventional h 
enhancement unit is placed in the 
masking unit, and a combination of ari 
unit and an unsharp masking unit is 



prodessing operations often include both 
pixel-mapping algorithm for contrast 
found that application of the method 
ificantly improves the resulting picture 
mapping reduces noise amplification in 
mfihasised by the contrast enhancement 
Jqorithms do not enhance the noise. 



irriplementation of the present invention in 
mapping is used in conjunction with 
mapping contrast enhancement and 
istogram-based pixel mapping contrast 
original image branch of the unsharp 
inverse histogram-based pixel-mapping 
Diaced in a branch that is parallel to the 



20-DEC. ' OO(WED) 13:01 



FAX;01252865080 



P. 026 



ij;! 



10 



15 



20 



25 



30 



23 



of 



original image branch. The output 
output of the histogram-based pixel mapping 



Figure 13 shows a modified 
filtering block added In the original f 
the contrast enhancement operation, 
reduce the noise introduced by 
enhancement. 



arrangenhent in which an additional (low-pass) 
imiige branch (into the upper path), after 
The purpose of the filtering block is to 
cc^nventional histogram-based contrast 



A second aspect of the invention is 
provided a histogram-based pixel mapping 
unsharp masking unit In a branch of ar 
branch being parallel to the original 
branch is added to the original image 
mapping function adapts to the image 
found to be reduced. 



depicted in Figure 15, in which there is 
unit alongside and prior to an 
image enhancement arrangement, the 
jrr^age branch. The output of the parallel 
With this arrangement because the 
content, noise enhancement has been 



The present invention may also be a 
sequences, in which case it is 
the histogram. A video signal consists 
image can be enhanced individually, 
for two images that have different 
preferably gathered for each image 
sequence individually produces 
unnoticeable visual differences can 
different histograms. Therefore, te 
filtering, of the histograms is needec 
adaptive to sudden large changes in 
scene-cuts. 



The present invention may be 
departing from its essential attributed 



the parallel branch is added to the 
contrast enhancement unit. 



advani ageous 



tut 



f)plied for enhancement of digital video 
to add temporal processing to 
of a sequence of digital images. Each 
the same histogram cannot be used 
corhtent. This means that histograms are 
However, processing images in the video 
disturbing flicker, because even quite 
two images to have substantially 
mf^oral processing, for example low pass 
Typically this kind of processing is 
irpage characteristics, for example due to 



emblodied in other specific forms without 
The inverse histogram-based pixel 
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mapping function of the present Invenl 
context of a pre-processor for an edge 
present invention may be used on its 
Figure 14 illustrates a number of 



5 histogram-based mapping function unit. Figure 14a shows the inverse 



histogram-based mapping unit applied 



shows the inverse histogram-based mapping unit as a post-processing unit for 



an edge enhancement unit. Figure 1 
mapping unit as a pre-processing unit 



ion has been described above in the 
enhancement function. However, the 
own or in a variety of different ways, 
different applications of an inverse 



on its own to an image. Figure 14b 



4c shows the inverse histogram based 
or an edge enhancement unit. Figure 



10 14d shows an inverse histogram-base<J mapping unit in parallel with an edge 



enhancement unit. Figure 14e shows 
units, one in an original image branch 



two inverse histogram-based mapping 
and used as a pre-processing unit for a 



low pass filter, and the other one in a parallel branch, as a pre-processing unit 
for an edge enhancement unrf. Ottjier inverse histogram-based mapping 



15 arrangements are possible, in which 



image's statistical data-dependent pixe^l mapping function to the image pixels 



in such a way that image contrast is 



large number of pixels and increased in other signal ranges 



Accordingly reference should be 
general statements herein rather than 
indicating the scope of invention. 



in 



Furthermore, each feature disclosed i 
the claims) and/or shown in the drawlrjgs 
independently of other disclosed and/c>r 
invention includes any novel featurei5 
herein either explicitly or any generalisation 
not it relates to the claimed invention 
addressed. 



the method comprises applying the 



reduced in signal ranges containing a 



matle to the appended claims and other 
to the foregoing specific description as 



this specification (which term includes 
may be incorporated in the invention 
illustrated features. In this regard, the 
or combination of features disclosed 
thereof irrespective of whether or 
or mitigates any or all of the problems 
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The appended abstract as filed herewith 
reference. 

What is claimed is: 



IS 



included in the specification by 



